A simulation-based approach to stochastic dynamic programming
نویسندگان
چکیده
منابع مشابه
A Simulation-based Approach to Stochastic Dynamic Programming
In this paper we develop a simulation-based approach to stochastic dynamic programming. To solve the Bellman equation we construct Monte Carlo estimates of Q-values. Our method is scalable to high dimensions and works in both continuous and discrete state and decision spaces whilst avoiding discretization errors that plague traditional methods. We provide a geometric convergence rate. We illust...
متن کاملA Logic-based Approach to Dynamic Programming
We present a first-order value iteration algorithm that addresses the scalability problem of classical dynamic programming techniques by logically partitioning the state space. An MDP is represented in the Probabilistic Fluent Calculus, that is a first-order language for reasoning about actions. Moreover, we develop a normalization algorithm that discovers and prunes redundant states. We have i...
متن کاملA Mathematical Programming Approach to Stochastic and Dynamic Optimization Problems
We survey a new approach that the author and his co-workers have developed to formulate generic stochastic and dynamic optimization problems as mathematical programming problems. The approach has two components: (a) it produces bounds on the performance of an optimal policy, and (b) it develops techniques to construct optimal or near-optimal policies. The central idea for developing bounds is t...
متن کاملA Numerical Approach to Stochastic Optimal Control via Dynamic Programming
This paper presents a strategy for finding optimal controls of nonlinear systems subject to random excitations. The method is capable to generate global control solutions when state and control constraints are present. The solution is global in the sense that controls for all initial conditions in a region of the state space are obtained. The approach is based on the Bellman’s Principle of opti...
متن کاملDynamic Asset Allocation Strategies Using a Stochastic Dynamic Programming Approach∗
A major investment decision for individual and institutional investors alike is to choose between different asset classes, i.e., equity investments and interest-bearing investments. The asset allocation decision determines the ultimate risk and return of a portfolio. The asset allocation problem is frequently addressed either through a static analysis, based on Markowitz’ mean-variance model, o...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Stochastic Models in Business and Industry
سال: 2011
ISSN: 1524-1904
DOI: 10.1002/asmb.896